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Abstract: Recently, a framework for the approximation of the entire set of e-efficient 
solutions (denote by E^) of a multi-objective optimization problem with stochastic search 
algorithms has been proposed. It was proven that such an algorithm produces - under mild 
assumptions on the process to generate new candidate solutions -a sequence of archives which 
converges to E^ in the limit and in the probabilistic sense. The result, though satisfactory 
for most discrete MOPs, is at least from the practical viewpoint not sufficient for continuous 
models: in this case, the set of approximate solutions typically forms an n-dimensional 
object, where n denotes the dimension of the parameter space, and thus, it may come to 
perfomance problems since in practise one has to cope with a finite archive. 
Here we focus on obtaining finite and tight approximations of E^, the latter measured by 
the Hausdorff distance. We propose and investigate a novel archiving strategy theoretically 
and empirically. For this, we analyze the convergence behavior of the algorithm, yielding 
bounds on the obtained approximation quality as well as on the cardinality of the resulting 
approximation, and present some numerical results. 
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Computing a Finite Size Representation of the Set of 
Approximate Solutions of an MOP 

Resume : Dans des travaux precedent, nous avons propose un environncnient ("frame- 
work") pour I'approximation de I'integralite de I'ensemble des solutions e-cfBcaces (note i?e) 
d'un probleme d'optimisation niulti-objectifs a I'aide d'une recherche stochastique. II a ete 
prouve que suivant certaines hypotheses relatives au processus de generation de nouvelles 
solutions candidates, un tel algorithme produit unc sequence d'archives qui converge asynip- 
totiquement vers E^, au sens probabiliste du terme. Le resultat, s'il est satisfaisant pour 
la plupart des MOP discrets, ne Test pas d'un point de vue pratique pour les problemes 
continus. Dans ce dernier cas, I'ensemble des solutions approximees forme un objet a n 
dimcntions, oil n est la dimension de I'espace des parametres. Ceci pent amener a des 
problemes de performances puisqu'en pratique la taille de I'archive est finie. 

Dans le travail presente, nous nous conccntrons sur I'obtention d'approximations finies et 
precises de E^ qui est mesure par la distance de Hausdorff. Nous proposons et nous etudions 
une nouvelle strategic d'archivage des points de vue theorique et pratique. Pour ce faire, 
nous analysons Ic comportement asymptotique de I'algorithme, en fournissant les limites de 
qualite de I'approximation obtcnue, aussi bien que la cardinalite de I'approximation ct nous 
presentons egalement quelqucs resultats numcriques. 

Mots-cles : optimisation multi-objcctif, convergence, solutions e-efficaces, solutions 

approwimees, algorithmes de recherche stochastique. 
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1 Introduction 

Since the notion of e-efEciency for multi-objective optimization problems (MOPs) has been 
introduced more than two decades ago ([5]), this concept has been studied and used by many 
researchers, e.g. to allow (or tolerate) nearly optimal solutions ([8], [18]), to approximate 
the set of optimal solutions ([H]), or in order to discretize this set ([7], [H])- e-efScient solu- 
tions or approximate solutions have also been used to tackle a variety of real world problems 
including portfolio selection problems ([19'), a location problem ([Ij), or a minimal cost flow 
problem ([H]). 

As an illustrative example where it could make sense from the practical point of view to 
consider in addition to the exact solutions also approximate ones we consider a plane truss 
design problem, where the volume of the truss as well as the displacement of the joint to a 
given position have to be minimized (see also Section 6.2). Since the designs of this problem 
- as basically in all other engineering problems ~ have to obey certain physical contraints 
such as in this case the weight and stability of the structural element, the objective values 
of all feasible solutions are located within a relatively tight and a priori appreciable range. 
Hence, the maximal tolerable loss of a design compared to an 'optimal' one with respect to 
the objective values can easily be determined quantitatively and qualitatively by the decision 
maker (DM) before the optimization process. The resulting set of exact and approximate 
(but physically relevant) solutions obtained by the optimization algorithnu leads in general 
to a larger variety of possibilities to the DM than 'just' the set of exact solutions: this is due 
to the fact that solutions which are 'near' in objective space can differ significantly in design 
space (e.g., when the model contains symmetries, or see Section 6.3 for another example). 
The computation of such approximate solutions has been addressed in several studies. In 
most of them, scalarization methods have been empoyed (e.g., [IH], [2], (Ij). By their nature, 
such algorithms can deliver only single solutions by one single execution. The only work so 
far which deals with the approximation of the entire set of approximate solutions (denote by 
E^) is [13], where an archiving strategy for stochastic search algorithms is proposed for this 
task. Such a sequence of archives obtained by this algorithm provably converges - under 
mild assumptions on the process to generate new candidate solutions - to E^^ in the limit 
and in the probabilistic sense. This result, though satisfactory for most discrete MOPs, is 
at least from the practical viewpoint not sufficient for continuous models (i.e., continous 
objectives defined on a continuous domain): in this case, the set of approximate solutions 
typically forms an n-dimensional object, where n denotes the dimension of the parameter 
space (see below). Thus, it may come to performance problems since it can easily happen 
that a given threshold on the magnitude of the archives is exceeded before a 'sufficient' ap- 
proximation of the set of interest in terms of diversity and/or convergence is obtained. An 
analogue statement holds for the approximation of the Pareto front, which is 'only' (fc — 1)- 
dimensional for MOPs with k objectives, and suitable discretizations have been subject of 
research since several years (e.g., [7]i [H; [H])- 
The scope of this paper is to develop a framework for finite size representations of the set _Ee 



^Here we assume an idealized algorithm, since in practise every solution is an approximate one. 
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with stochastic search algorithms such as evolutionary multi-objective (EMO) algorithms. 
This will call for the design of a novel archiving strategy to store the 'required' solutions 
found by the stochastic search process. We will further analyze the convergence behavior 
of this method, yielding bounds on the approximation quality as well as on the cardinality 
of the resulting approximations. Finally, we will demonstrate the practicability of the novel 
approach by several examples. 

The remainder of this paper is organized as follows: in Section 2, we state the required 
background including the set of interest Pq^e- In Section 3, we propose a novel archiving 
strategy for the approximation of Pq^e and state a convergence result, and give further on 
an upper bound on the resulting archive sizes in Section 4. In Section 5, we present some 
numerical results, and make finally some conclusions in Section 6. 

2 Background 

In the following we consider continuous multi-objective optimization problems 

min{F(a;)}, (MOP) 

where Q C R" and F is defined as the vector of the objective functions F : Q -^ 
R*^, F{x) = {fi{x), . . . , fk{x)), and where each /^ : Q — > IR is continuously differentiable. 
Later we will restrict the search to a compact set Q, the reader may think of an n-dimensional 
box. 

Definition 2.1 (a) Let v,w ^ Q. Then the vector v is less than w (v <p w), if Vi < Wi 
for all i ^ {1, . . . , fc}. The relation <p is defined analogously. 

(h) y G R" is dominated by a point x £ Q (x < y) with respect to \MOP\) if F{x) <p F(y) 
and F{x) ^ F{y), else y is called nondominated by x. 

(c) x Cz Q is called a Pareto point if there is no y ^ Q which dominates x. 

The set of all Pareto optimal solutions is called the Pareto set (denote by Pq). This set 
typically - i.e., under mild regularity assumptions - forms a (fc— l)-dimensional object. The 
image of the Pareto set is called the Pareto front. 

We now define another notion of dominance, which is the basis of the approximation concept 
used in this study. 

Definition 2.2 Let e = (ei, . . . , e^) e R'^ and x,y (z Q. 

(a) X is said to e-dominate y (x <^ y) with respect to JMOP]) if F{x) — e <p F{y) and 
F{x)-e^F(y). 
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(b) X is said to —e-dominate y (x ^_e y) with respect to \MOP\) if F(x) + e <p F[y) and 
F{x)+e^F{y). 

The notion of — e-dominance is of course analogous to the 'classical' e-dominance relation 
but with a value e € R^. However, we highlight it here since it will be used frequently 
in this work. While the e-dominance is a weaker concept of dominance, —e-dominance is a 
stronger one. 
We now define the set which we want to approximate in the sequel. 

Definition 2.3 Denote by Pq^e the set of points in Q d IR" which are not —e-dominated 
by any other point in Q, i.e. 

Pq,, ■.^{xeQ\^yeQ:y -<_e x}. (1) 

To see that Pg.e typically forms an n-dimensional set let xq G Pq (such a point, for instance, 
always exists if Q is compact). That is, there exists no y € Q such that y < xq. Since F is 
continuous and e G R^ there exists a neigborhood U of xq such that 

^yeQ: y-(-,u VueC/nQ, (2) 

and thus, U H Q G Pq^e, and we are done since U is n-dimensional. 

The following result and notions are used for the upcoming proof of convergence. 

Theorem 2.4 ([12j) Let (MOP) be given and g : R" -> R" be defined by q{x) = Y!1^^ aiVfi{x), 
where a is a solution of 

k 



mm 



^aiV/i(a 



; a,; > 0, i = 1, . . . , fc, 2^ Oii — 1 
2 »=i 



Then either q{x) = or —q{x) is a descent direction for all objective functions /i, . . . ,/fe 
in X. Hence, each x with q{x) — fulfills the first- order necessary condition for Pareto 
optimality. 

Definition 2.5 Let u e R" and A, B C R". The semi-distance dist{-, •) and the Hausdorff 
distance d/f (■, ■) are defined as follows: 

(a) dist{u, A) := inf ||m— w|| 

(b) dist{B,A) :— sup dist{u,A) 

ueB 

(c) dH{A,B) ■.= m&yi{dist{A,B),dist{B,A)} 

o o 

Denote by A the closure of a set A e R", by A its interior, and by dA = A\A the 
boundary of A. 
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Definition 2.6 (a) A point x (z Q is called a weak Pareto point if there exists no point 
y (z Q such that F(jj) <p F{x). 

(b) A point X €z Q is called — e weak Pareto point if there exists no point y € Q such that 
F{y)+e<pFix). 

Algorithm [1] gives a framework of a generic stochastic multi-objective optimization al- 
gorithm, which will be considered in this work. Here, Q C R" denotes the domain of the 
MOP, Pj the candidate set (or population) of the generation process at iteration step j, and 
Aj the corresponding archive. 

Algorithm 1 Generic Stochastic Search Algorithm 



Po C Q drawn at random 
Aq = ArchiveUpdate{Po,il}) 
for j = 0,1,2,... do 

Pj+i = Generate(Pj) 

Aj^i = ArchiveUpdate{Pj-i-i, Aj) 
end for 



3 The Algorithm 

Here we present and analyze a novel archiving strategy which aims for a finite size repre- 
sentation of Pq^c- 

The algorithm which we propose here, ArchiveUpdatePQ,^, is given in Algorithm^ Denote 
by lA :— (A, . . . , A) G R*^, where A e IR+ can be viewed as the discretization parameter 
of the algorithm. 

Algorithm 2 A := ArchiveUpdatePQ^^ (P, Aq, A) 

Require: population P, archive Aq, A e R+, A* e (0, A) 
Ensure: updated archive A 
A:=An 



for all p e P do 

if ^fli e A : a -(_e P and ^03 G A : doo{F{a), F{p)) < A* then 
A:^ AU {p} 
for all a e A do 

if p -<-(e+iA) o- then 

A := A\{a} 
end if 
end for 
end if 
end for 
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Lemma 3.1 Let Ao,P <Z R" be finite sets, e e ]R'!l_, A e 11+, and 
A :— ArchiveUpdateEpsl {P,Ao). Then the following holds: 

Vx £ P U Aq : 3a e A: a ^ia x. 

Proof: This follows immediately by the construction of the algorithm. 



Theorem 3.2 Let an MOP F : M" -^ R be given, where F is continuous, let Q C R" be a 
>fc 



compact set and e G R+, A, A* e R+ with A* < A. For the generation process we assume 



yx e Q andyS > : P{3lelM : Pif] Bs{x) n Q 7^ 0) = 1 (3) 

and for the MOP 

(Al) Let there be no weak Pareto point in Q\Pq. 



(A2) Let there be no — e weak Pareto point in Q\PQ^e, 

(A3) Define 6 := {x e Q\3y £ Pq : F{y) + e = F{x)}. Let B C Q and q{x) + for all 
X (£ B, where q is as defined in Theorem\ 



Then, an application of Algorithm]^ where 
AchiveUpdatePQ,= {P, A, A) is used to update the archive, leads to a sequence of archives 
Ai,l (z ¥i, where the following holds: 

(a) For all I elM it holds 

||F(ai)-F(a2)||oo>A* (4) 

(b) There exists with probability one an Iq €¥i such that for all I > Iq: 

(bl) dist{F{PQ^,),F{Ai))<A 

(b2) dist{F{Ai),F{PQ^,)) < dist{F{PQ,,+2A).F{PQ,,)) 

(bS) dH{F{PQ,,),F{Ai))<D, where 

D = max{A,dist{F{PQ^,+2A).F{PQ^,)) 

Proof: Before we state the proof we have to make some remarks: a point p is discarded 
from an existing archive A in two cases (see line 3 of Algorithm [5|) : 

(£)1) 3aie A: oi <^e P, or 

(D2) 3a2GA: \\F{w2)-F{p)\\^<A*. ^' 

Further, we define by 

Br{x):={yeli'' : \\x - y^ < 5} 

a /c-dimensional open box around x G R . Now we are in the position to state the proof. 
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Claim (a): follows immediately by construction of the algorithm and by an inductive 
argument. 
Claim (bl): By (a) it follows that for an elem,ent a from a given archive A it holds 

Fid) ^ B^.{F{a)), ydeA\{a}, (6) 

Since further Q is compact and F is continuous it follows that F(Q) is bounded, and thus, 

there exits an upper bound for the number of entries in the archive for a given MOP, denote 

by uq — uq^A* , F{Q)) (see also Section 4)- 

Since Pq.e is compact and 

dist{F(PQ^g), F{Ai)) — dist[F{PQ^^),F{Ai)), and since Ai,l € N, is finite it follows that 

dist{F{PQ^,),F{Ai)) ^ max min \\F{p) - F(a)|loo 
■pePQ,c aeAi 

That is, the claim is right for an archive Ai,l € N, if for every p G Pq,^ there exists an 
element a e A; such that ||i^(p) — F{a)\\ao < A. Thus, F{Pq,^) must be contained in Ca,,A; 
where 

Caa := U Bt{F{a)). 

aeA 

First we show that if there exists an Iq (z ¥i with 

dist{F[PQ^^), F{Ai)) < A, this property holds for all I > Iq. Assume that such an Iq is given. 

Define 

A:={ae Ai„\3p e Pq,. : \\Fip) - F{a)\\oo < A} (7) 

Since it holds that 

p e PQ,e andaeQ : \\F{p) - F{a)\\ < A ^ a e Pq^e+iA 

it follows that A C Pq. e+iA, o,nd thus, no element a ^ A will be discarded further on due to 
the construction of ArchiveUpdatePQ,^. Since dist{F{PQ,f),F{Ai)) < A it follows that for 
all p e Pq.c there exists an element a (z A such that \\F{p) — _F(a)||oo < A. By the above 
discussion this holds for all I > Iq, and since no element a £ A is discarded during the run 
of the algorithm, and the claim follows. 

It remains to show the existence of such an integer Iq, which we will do by contradiction: 
first we show that by using ArchiveUpdatePq^t and under the assumptions made above 
only finitely many replacements can be done during the run of the algorithm. Then we 
construct a contradiction by showing that under the asssumptions made above infinitely 
many replacem,ents have to be done during the run of the algorithm with the given setting. 
Let a finite archive Aq be given. If a point p G R" replaces a point a £ Aq (see lines 4 and 
7 of Algorithmic it follows by construction of ArchiveUpdatePQ^e tho,t 

F{p) <p F{a) - A (8) 

Since the relation '< ' is transitive, there exists for every a £ A a 'history ' of replaced 
points Oi £ Ai. where equation (0) holds for Oi and Oi^i. Since F{Q) is bounded there exist 
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li,Ui G R, i = 1, . . . , /c, such that F{Q) C [?i,ui] x ... x [li^^Uk]. After r replacements there 
exists at least one a G ^/(r) such that the length h of the history of a is at least h > [r/nol ; 
where no is the maximal number of entries in the archive (see above). Denote by oq £ Aq 
the root of the history of a. For a,ao it follows that 

F{a) < F{ao) ~ hA 

For h > h„iax '■— A~^ niaxi=i^...^fc Mi — li we obtain a contradiction since in that case there 
exists i e {1, . . . , n} with fiifl) < U and thus F{a) ^ F{Q). Hence it follows that there can 
be done only finitely many such replacements during the run of an algorithm. 

Assume that such an integer Iq as claimed above does not exist, that is, that F{Pq^i,) ^ 
Cai,a for all I e N. Hence there exists a sequence of points 

P^&PQ..e■. y^ = F{p,) e F{Pq^,)\Ca,,a Vl G N. (9) 



Since Pq^c C Q and Q is compact there exists an accumulation point p* G -Pg.e, that is, 
there exists a subsequence {ij}j^^ with 



Pi^ -^p* e PQ,e forj -> oo. (10) 

In fWj/ it was shown that under the assumptions (A1)-(A3) it follows that 



Pq... = Pq..., (11) 

i.e., that Pq.c is not 'fiat' anywhere. Hence, the set 

f^i^^^(l-A)/2(2^*)n^Q.- (12) 

where y* :— F{p*), is not empty. By Q) it follows that there exists with probability one an 
/i G N and an element xi G Pia+i-^ generated by Generate() with yi = F{xi) G Ui. There 
are two cases for the archive Ai^j^i-^^: (a) xi can be discarded from the archive, or (b) xi is 
added to it. Assume first that xi is discarded. Since xi G PQ,e there exists no x £ Q such 
that X —e-dominates x\. Hence, (I?l) can not occur (see 0)j, and thus, there must exist 
an a2 G ^!o+'i such that ||F(a2) — -F(a;i)||oo < A* (see {D2)). Thus, whether xi is added to 
the archive or not there exists an oi G Ai^^i-^ such that \\F{ai — y*\\oo < A (since in case 
xi is added to the archive oi — x\ can be chosen), and we obtain 

\\F{ai)~y\\o,<\\F{ai)-F{xi)\\oo + \\F{xi)-y\\o,<A Vy G f/i (13) 

By (0) and IJOj) there exist integers ji,li G N with 

Since by il3\) it holds that \\yi^ — -F(ai)||oo < A it follows that oi ^ A^ , ^ ,j , which is only 
possible via a replacement in Algorithm\^ (lines 4 and 7). 
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In an analogous way a sequence {aijigN of elements can be constructed which have to he 

replaced by other elements. Since this leads to a sequence of infinitely many replacements. 

This is a contradiction to the assumption, and the proof is complete. 

Claim (b2): Let A and Iq as above, and let I > Iq. Further, let x € Q\PQ.e+2A, that is, 

there exists a p £ Pq^e such that p ■<-(e+2A) ^- Since I > Iq there exists an a Cz A d Ai 

such that \\F(p) — i^(a)||oo < A. Combining both facts we see that a ^_(e_|_iA) x. Thus, 

no element x € Q\PQ.e+2A *s contained in Ai,l > Iq, or will ever be added to the archive 

further on. The claim follows since the archive can only contain elements in Pq,c+2A (see 

also Examples \3.4\ and \3.5]} . 

Claim (bS): follows immediately by (bl) and (b2). 

Remarks 3.3 (a) For A — A* = the archiver coincides with the one proposed in \1^ . 
which reads as 

UpdatePQ,^{P, A) -.^ {x e P Li A : y y^^e X Vy e P U A}. (15) 

(b) The convergence result holds for a scalar Aq G IR+ which is used for the discretization 
of the e-efficient front. However, analogue results can be obtained by using a vector 
A S R^. In this case, the exclusion strategy in line 3 of Algorithm 2 has to be replaced 
by 

^02 e A: Fip)eB{Fia2),A), (16) 

where 

B{y, A) := {x G R*^ : \x, - y^\ < A,, i = 1, ., k}. 

Further, elements a have to be discarded from the archive if they are — (e+A) dominated 
by p (lines 6-8). 

(c) In the algorithm the discretization is done in the image space (line 3 of Algorithm 2). 
By replacing this exclusion strategy by 

^02 e A: d^ia,p)<A*, (17) 

an analogue result with discretization in parameter space can be obtained. This will 
lead on one hand to approximations which could be more 'complete', but on the other 
hand certainly to archives with much larger magnitudes since Pq^e is n-dimensional 
(see also the discussion in Section 4)- 

(d) The parameter A* G R_|_ with A* < A is used for theoretical purposes. In practise, 
A* — A can he chosen. 

(e) Note that the convergence result also holds for discrete models. In that case, assumption 
(0) can he modified using Markov chains such that it can easier be verified (see e.g., 

m). 
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The next two examples show that with using ArchivellpdatePQ^,, one cannot prevent 
to maintain points x e ^q.£+2a\^q.c in the hmit archive, and that the distance between 
F(PQ^e+iA) (respectively F[Pq^^+2a)) and F[Pq^^) can get large in some (pathological) 
examples. 

Example 3.4 Consider the following MOP: 

i^:IR^R, F{x)=x (18) 

Let Q — [0,5], e = 1,A = 0.1, and let A* — A. Thus, we have Pq.e — [0,1]. Assume 
that A = {ai} with ai = 1.2. // next 02 = 0.1 is considered, it will be inserted into the 
archive since doc{F{ai), F{a2)) > A and since 02 S Pg.e is not ^e-dominated by ai nor 
by any other point x Cz Q, and will thus remain in the archive further on. Since 02 is not 
— (e + l^)- dominating ai we have for the updated archive A = {01,02}. Hence, no element 
a G [0, A] will be taken to the archive since for these points it holds dao{F{a),F{a2)) < A*, 
and thus, 02 G PQ,e+2A\PQ,<L will not be discarded from the archive during the run of the 
algorithm. 

When on the other side a\ = Q is taken to the archive, no element a G Q\Pq^^ will ever be 
accepted further on. 

Example 3.5 Let the MOP be given by F : M. ^ Wi^ , where 

J- ^ \ 1,11 J- ^ \ f I2; — 1| for X < 1 ,,„- 

A(x) = |x + l|, /2(x) = | ^j^_^j 1^^^;^ , (19) 

where a G (0, 1) (see also Figure\^. For simplicity we assume that e = (e, e) G R^. It is 
Pq = [-1,1] with 

F(-l) = (0,2), F(l) = (2,0) (20) 

Further, it is 

F(-l-6-) = (e-,2 + e-), p(l + 1) = (2 + 1, e) (21) 

a a 

Using this and some monoticity arguments on /i and /2 we see that 

'' (22) 



PQ,e = (-1 - e, 1 - 
Since F{1 + ^) = (2 + ^,e + A) it follows that 



dzsi(i^(PQ,,+iA), F(PQ,e)) = -, (23) 

Q 



which can get large for small values of a. 
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(a) Parameter space (b) Image space 

Figure 1: Example of MOP (HH) for a = 0.1. 



4 Bounds on the Archive Sizes 

Here we give an upper bound U on the size of the hniit archive obtained by the novel 
strategy, and discuss that the order of U is already optimal. 

Theorem 4.1 Let e g R^, A*, A e 1R+ with A* < A be given. Further let rm = 



miUxeQ fi{^) o,i^d Mi = max^igQ fi{x), I < i < k, and Iq as in Theorem \S.2[ Then, when us- 
ing ArchiveUpdatePq^^, the archive size maintained in Algorithm{J\for all I > Iq is bounded 
as 



/ \ k k k 



(24) 



3 = 1 



Proof: Let / > ^o and the archive Ai be given. Since Ai C PQ,t+2A (see Theorem I3.2p we 
are interested in an upper bound on the volume of F{Pq^^+2a)- For this, we consider first the 
(A; — l)-dimensional volume of the Pareto front F{Pq). Due to the nature of nondominance 
we can assume that F{Pq) is located in the graph of a map 



•^f -.K ^W 

$/(ui,. .. ,Ufe-l) = (m1,. ..,Mfc-l,/(ui,.. .,Ufc-l)), 



(25) 
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where K := [rni,Mi] x ... x [mk-i,Mk-i] and f : K ^ [mk,Mk] which satisfies the 
monotonicity conditions 

f{ui, . . . ,Ui^i,Xi,Ui+i, . . . ,Ufe_i) < /(ui, . . . ,u,^i,y,,Ui+i, . . . ,Uk-i) 

yi = I, . . . ,k — 1, 

(26) 
Uj G [mj,Mj],j = I,. . . ,i — l,i + 1,. . . ,k — I, 

Xi.Tji e [m.„Mi\,Xi < yi. 

Further, we can assume that / is sufficiently smooth. If not, we can replace / by a smooth 
function / such that the volume of $^ is larger than the volume of $/ as the following 
discussion shows: 

if f{mi, . . . ,mfe_i) = ruk, the Pareto front consists of one point, F{Pq) = {(toi, . . . ,mk)}-, 
and has minimal volume 0. Since we are interested in upper bounds on the volume we can 
omit this case. Doing so, a smooth function f : K ~* [niki Mk] exists with f{x) < f{x), \/x g 
K that fulfills the monotonicity conditions ([26|l . The (fc — l)-dimensional volume of $5 is 
obviously larger than the volume of <i>y. Under the smoothness assumption we can replace 
condition ((^ by 

-^u<0, \fueK,\fi = l,...,k-l. (27) 

dui 

The (fc — l)-dimensional volume of <i>j with parameter range K is given by (see [S]): 

Voh-i{<^f) = I V||V/|P + ldw, (28) 

J K 

where V/ denotes the gradient of /. Analogue to [M] (see also Appendix 1) the volume can 
be estimated by using partial integration and the monotonicity conditions (j27p by: 

k k 

Voh_^{<^f) < E n(*^^ - "^^)- (29) 

1=1 3 = 1 

Considering this and the nature of — e-dominance we can bound the fc-dimensional volume 
of F{Pq^,+2a) by: 

k k 

Volk{F{PQ^,+2A)) < Y.^e, + 2A) [](M, - m,), (30) 

i=l 3=1 

Since |lF(ai) — -F(a2)|l — ^* foi" ^-ll 017^2 € Ai it follows that the boxes 

Bf^.(F(a)), a^Ai, (31) 
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are mutually nonoverlapping. Further, if F(a) e -F(i^Q,e+2A), then BT^,{F{a)) is included 

in a A*/2-neighborhood F of F{Pq^^^2a) with 

fc fe 

Voh{F) < ^(e, + 2A + A*) [|(M, - m^ + A*). (32) 

i=l 3=1 

The maximal number of entries in Ai can now be estimated by 

'^'' - 1/0^,(5-^. (F(a)))' ^^^^ 

and the claim follows since the volume of _B?°. .(i^(a)) is obviously given by (A*)*^. 

In particular interesting is certainly the growth of the magnitudes of the (limit) archives 
for vanishing discretization parameter A. Since for every meaningful computation the value 
A will be smaller than every entry of e, we can assume ti = CiA with Ci > 1. Using ^^ 
and for simlicity A = A* we see that 

t. "] k k 

l^'l ^ ( i ) E(^^ + 3) n(^^. - ^, + A*). (34) 

Thus, the growth of the magnitudes is of order C* ( (3) J for A —+ 0. Regarding the 

fact that Pq, which is contained in Pg^e for all values of e € R^, typically forms a (fc — 1)- 
dimensional object, we see that the order of the magnitude of the archive with respect to 
A is already optimal. This is due to the fact that the discretization (line 3 of Algorithm 
2) is realized in image space. An analogue result for a discretization in parameter space, 
however, can not hold since Pg.e is n-dimensional. 

Remark 4.2 In case the algorithm is modified as described in Rem,ark \3.3\ (c), the upper 
hound for the magnitude of the archive is given by 

|Af|<^ + l \{{h^a,), (35) 

\ / j=i 

where Q C [ai, 61] x . . . x [a„,6„] (pQ,e+2A is certainly included in [ai,6i] x ... x [a„,6„], 
and maximal 1/A* + 1 elements can be placed in each coordinate direction) . To see that this 
bound is tight we consider the example 

F : [0, 1]" ^ ]R^ F{x) = Co G ]R'=, (36) 

and let A = 1/s, s G N. Define a;ii,....i„ — (iiA, . . . ,i„A) and 

V:={x^,,...,,jO<ii,...,in<s}. (37) 
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Table 1: Comparison of the magnitudes of the final archive (|A^i„a;|, rounded) and the 
corresponding update times {T, in seconds) for MOP ([55]) and for different values of A. We 
have taken the average result of 100 test runs. 




0.01 
0.05 



3836 

827 
68 



32.98 
6.22 
1.80 



Since V C [0,1]" and ^00(^1, 2:2) > A > A* for all zi,Z2 € V, zi ^ zi, all points in V 
will be accepted by the archiver (assuming that only points z (z V are inserted) leading to an 
archive A with \A\ = |P| = (s + 1)". 

Since Pq.e is n- dimensional, the growth of the magnitudes of the archives is also beyond this 
constructed example of order C* ((s) ) for A — > 0. This makes a huge difference to the 
other archiver since for general MOPs we have n^ k. 

5 Numerical Results 

Here we demonstrate the practicability of the novel archiver on five examples. For this, we 
run and compare ArchiveUpdatePq ^^ for difierent values of A including Aq — 0, which is 
the archiver which accepts all test points which are not — e dominated by any other test 
point (see Remark 4.3 (a)). To obtain a fair comparison we have decided to take a random 
search operator for the generation process (the same sequence of points for all settings). An 
implementation of the archiver including these examples can be found in [1] . 

5.1 Example 1 

First we consider the MOP suggested by Tanaka (|16j): 

F : R2 ^ R2, i^(a;i, a;2) = (xi, 0:2) (38) 

where 

Ci{x) = x1 + X2 — i — 0.1 cos(16arctan(a;i/x2)) > 
C2ix) = [xi - 0.5)2 ^ (^^ _ Q 5)2 < Q 5 

Figure [5] shows a numerical result for N = 200, 000 randomly chosen points within 
Q = [0, 7r]2 and for three different values of the discretization parameter: Aq = 0, Ai = 0.01 
and A2 = 0.05. As anticipated, the granularity of the resulting archive increases with the 
value of A. Thus, the approximation quality decreases, but also the running time of the 
algorithm (see Tabled]). 
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(a)Ao = 0, |A^-„,n = 3824 
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(b) Deltai = 0.01, lAj-^^^H = 834 



Figure 2: Results for MOP 
the approximation. 
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5.2 Example 2 

Next, we consider the following MOP proposed in [10] 



F : r2 -^ R^ 



F{xi,X2 

where 

ii = sgn(a::i) min 



(a;i -ti{c + 2a) + a)^ + {x2 - t2bf 
[xi -ti(c + 2a) - af + {x2 - t2bf 



(39) 



jxil — a — c/2 
2a + c 



,1,^2= sgn(x2)min 



12:21-6/2 



The Pareto set consists of nine connected components of length a with identical images. We 
have chosen the values a = 0.5, 6 = c = 5, e = (0.1, 0.1), and the domain as Q = [—20, 20]^. 
Figure [3] shows some numerical results for N = 100,000 randomly chosen points within 
Q and for the three variants of the archiver ArchiveUpdatePqy. (a) A = (0,0), i.e., the 
archiver which aims to store the entire set Pg^e, (b) a discretization (in image space) using 
A = (0.02,0.02), and (c) the variant which is described in Remark 13.31 (c) using A^^ = 
(0.1,0.1) for a discretization of the parameter space. As anticipated, the solution in (b) is 
more uniform in image space compared to the solution in (c), which is, in turn, more uniform 
in parameter space. Note that the solution in (b), i.e., where the discretization has been 
done in image space, already 'detects' all nine connected components in parameter space. 
This is certainly due to the fact that the search has been done by selecting random points 
wich are uniformly distributed within Q. One interesting point for future studies would be 
to investigate if this capability still holds when other search strategies are chosen (which 
include, e.g., local search strategies). 

5.3 Example 3 

Finally, we consider the production model proposed in [12j : 
/i,/2:R"^R, 



/iG^) = E = 



'J' 



j=i 



(40) 



where 



Wj (z) 



f2ix)^l~Y[{l~W,{x,)), 



0.01-exp(-(^)2-5) for j-1,2 



0.01 •exp(-^) 



for 3 < J < n 
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(a) A = (0,0), |A^,„„,| = 2150 



0.2 0.4 0.6 O.S 1 1.2 1.4 1.6 1 .£ 



(b) A = (0.02,0.02), \Af,^ai\ = 365 



1.4 - ■: 

1.2'^'". 



c\j r.. ■■ 

0.8 - ■ ■ ■ 



0.2 - 

oL 



0.2 0.4 0.6 O.S 1 1.2 1.4 1.6 1 .£ 



(c) A, = (0.1,0.1), |A^„,,,1=410 



Figure 3: Numerical results for MOP ([M)l for the three different variants of 
ArchiveUpdatePq^^. 
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The two objective functions have to be interpreted as follows, /i represents the sum of 
the additional cost necessary for a more reliable production of n items. These items are 
needed for the composition of a certain product. The function /2 describes the total failure 
rate for the production of this composed product. 

Here we have chosen n = 5,Q — [0, 40]", and e — (0.1, 0.001) which corresponds to 10 percent 
of one cost unit for one item (ei), and to 0.1 percent of the total failure rate (£2). Figure H] 
shows numerical results for (a) A = (0, 0) and (b) for A ~ e/3. Note the symmetries in the 
model: it is e.g., F{xi,X2, ■ ■ ■) — F{x2,xi, . . .) by which is follows that the two connected 
components at xi = and a;2 = (see Figure |4] (a)) have the same image. Also in this 
case the archiver detects both components though the discretization has been done in image 
space (Figure [31(b)). 

5.4 Example 4 

Next, we consider a real-life engineering problem, namely the design of a four-bar plane 
truss ([IS]): 

F : R" ^ R2 
/i(x) = L{2xi + V2x2 + ^2x3 + Xi) 
. . . FL [ 2 2V2 2V2 1 \ 

L \Xi X2 X3 X4 J 

/i models the volume of the truss, and /2 the displacement of the joint. The model constants 
are the length L of each bar {L = 200 cm), the elasticity constants E and a of the materials 
involved {E ^ 2 x 10^ kN/cm'^, a = 10 kN/cm^), and the force F which causes the stress 
of the truss (F = 10 kN). The parameters Xi represent the cross sectional areas of the four 
bars of the truss. The physical restrictions are given by 

Q = [F/a, iF/a] x [\f2F/a, iF/af x [F/a, ZF/a] (42) 

For the allowed tolerances we follow the suggestion made in [Ij and set ei = 50 cm^ and 
€2 = 0.0005 cm. Figure E] shows a result for N = 500, 000 randomly chosen points within Q 
and for A = (10,0.0001), i.e., A^ = 6^/5 (see Remark 4.3 (b)). The final archive consists of 
78 elements, and the computational time was 5.5 seconds. In contrast, a run of the same 
algorithm with the same setting but with A = took 4 minutes and 21 seconds leading to 
an archive with 8377 elements. 

5.5 Example 5 

Finally, we consider a bi-objective {0,l}-knapsack problem which should demonstrate that 
the additional consideration of approximate solutions can be beneficial for the decision 
maker. 

n n 

/i, /2 : {0, 1}" -^ R, h{x) = Y. S-T^^' /2(2^) = E ^hi (43) 
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(a) A = (0,0), |A^,„„,| = 5939 



^^^^^V- 
^*i^. 




0.05 r 


0.045 


0.04 


0.035 


0.03 


^IM 0.025 


0.02 


0.015 


0.01 


0.005 




(b) A = (0.033,0.00033), \Afi„ai\ = 3544 

Figure 4: Numerical result for MOP (|in| : projections to the coordinates a;i,a;2,X3 of the 
final archive (left) and their images (right). 
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Figure 5: Numerical result for MOP (HJ). Here, we have chosen e = (50,0.0005) and 
A= (10,0.0001). 



RR n° 6492 



22 Schiltze, Coello, Tantar, Talbi 



s.t. 

n 

VjXj < W, Xj e {0, 1}, j = 1, 



T.' 



where c* represents the value of item j on criterion i,i — 1,2] Xj — 1, j ~ 1, ... ,n, ii item j is 
included in the knapsack, else Xj = 0. Wj is the weight of item j, and W the overall knapsack 
capacity. Figure [6] shows one numerical result obtained by an evolutionary strategjo for an 
instance with n = 30 items and with randomly chosen values c* £ [8,12], and capacity 
W = 15 (note that we are faced with a maximization problem). For e = (2, 2) and A = 0.1 
a total of 182 elements forms the final archive, and only six of them are nondominated. 
When taking, for instance, xq as reference (assuming, e.g., that this point has been selected 
by the DM out of the nondominated points) and assuming a tolerance of 1 which represents a 
possible loss of 0.6% compared to xq for each objective value, the resulting region of interest 
includes seven approximate solutions (see Figure ^. These solutions, though similar in 
objective space, differ significantly in parameter space: two solutions differ compared to xq 
in 8 items, one in 10, and 4 solutions differ even in 12 items. Thus, in this case it is obvious 
that by tolerating approximate solutions - where the loss of them can be determined a priori 
- a larger variety of possibilities is offered to the DM. 

6 Conclusion and Future Work 

We have proposed and investigated a novel archiving strategy for stochastic search algo- 
rithms which allows - under mild assumptions on the generation process - for a finite size 
approximation of the set Pq^^ which contains all e-efEcient solutions of an MOP within 
a compact domain Q. We have proven convergence of the algorithm toward a finite size 
representation of the set of interest in the probabilistic sense, yielding bounds on the ap- 
proximation quality and the cardinality of the archives. Finally, we have presented some 
numerical results indicating the usefulness of the approach. 

The consideration of approximate solutions certainly leads to a larger variety of possible 
options to the DM, but, in turn, also to a higher demand on the related decision making 
process. Thus, the support for this problem could be one focus of future research. Further, 
it could be interesting to integrate the archiving strategy directly into the stoachastic search 
process (as e.g. done in [3] for an EMO algorithm) in order to obtain a fast and reliable 
search procedure. 
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Figure 6: Numerical result for MOP ([1T|) with e = (2, 2) and A = 0.1. The rectangle defines 
one possible region of interest around j/o = F{xq) including seven approximate solutions (see 
text). 
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7 Appendix 1 

Here we show the inequahty in ()29p . which is taken from 
Define 



K, 



K 

(i) 

Hi) 



= [mi, Ml] X ... X [TOfe_i, Mfe_i], 

= [mi, Ml] X ... X [mi_i, Mi_i] x [m.,+i, M,+i] x . . . x [m^^i, Mfe_i], (44) 

= (Ul, . . . ,U,j_l,Ui+l, . . . ,M/c-l), i = 1, . . . ,fc- 1. 



Then, the (fc — l)-diniensional volume of $y with parameter range K can be bounded as 
follows: 



"■"'-'<*'> ^/,^/ra^*^/,V(l^ 



< 



df 



dui 



du 



K 



df 



duk-i 



Mi 



df 



'K 

fc-1 

i=i V^ii) V"'™ 

= ^ / \ ^ -^dui I du 

j=i \"'-'^(i) \ "'™ 
fe fc 

i=l J=i 



dui 



(0 



9ufc-] 



Idu 



du + I Idu 
K 



dui du^i) + / Idu 



Idu 



K 



(45) 
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